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Abstract — The problem of online packet scheduling with hard 
deadlines has been studied extensively in the single hop setting, 
whereas it is notoriously difficult in the multihop setting. This 
difficulty stems from the fact that packet scheduling decisions at 
each hop influences and are influenced by decisions on other hops 
and only a few provably efficient online scheduling algorithms 
exist in the multihop setting. We consider a multihop wired 
network (interference free and full duplex transmissions) in which 
packets with various deadlines and weights arrive at and are 
destined to different nodes through given routes. We study the 
problem of joint admission control and packet scheduling in order 
to maximize the cumulative weights of the packets that reach 
their destinations within their deadlines. We first focus on uplink 
transmissions in the tree topology and show that the well known 
earliest deadline first algorithm achieves the same performance as 
the optimal off-line algorithm for any feasible arrival pattern. We 
then address the general topology with multiple source-destination 
pairs, develop a simple online algorithm and show that it is 
0( Pm log Pm) -competitive under mild conditions where Pm is 
the maximum route length among all packets. Our algorithm 
only requires information along the route of each packet and 
our result is valid for general arrival samples. Moreover, we show 
that 0(Pm log Pm) -competitive is the best any online algorithm 
can do. Via numerical results, we also show that our algorithm 
achieves performance that is comparable to the non-causal optimal 
off-line algorithm. To the best of our knowledge, this is the first 
algorithm with a provable (based on a sample-path construction) 
competitive ratio, subject to hard deadline constraints for general 
network topologies. 



I. Introduction 

We consider a multihop wired network in which nodes 
receive packets with various (hard) deadlines, enqueued at the 
intermediate nodes through multiple hops along given routes 
to given destinations. We assume a time slotted system in 
which each packet has an identical (unit) length and each 
link in the network can serve an integer number of packets 
at a given time slot. Each packet has a certain weight and 
a deadline and we address the problem of scheduler design 
in order to maximize the total weight over the packets that 
are successfully transferred to their destinations within their 
deadlines. We first focus on the tree topology and show that 
the Earliest Deadline First (EDF) algorithm achieves the same 
performance as the optimal off-line algorithm for any feasible 
or under-loaded network arrival pattern 1 . Next, we study the 

'Note that a network arrival pattern is said to be under-loaded if there 
exists an off-line algorithm under which all packets can be served before their 
deadlines. 



general topology with multiple source-destination pairs. We 
develop a low-complexity on-line joint admission control and 
packet scheduling scheme and evaluate its competitive ratio 
with respect to the cumulative weight achieved by the optimal 
off-line algorithm. Our scheme only requires information of 
the packet queues along the route of each packet and is 
competitively optimal among all online algorithms. To the best 
of our knowledge, this is the first scheme with a provable (based 
on a sample-path construction) competitive ratio in general 
network topologies. 

The on-line packet scheduling problem with hard deadlines 
is gaining increasing importance with the emergence of cloud 
computing, large data centers, and grid communications. In 
such applications, a large amount of time-sensitive information 
needs to be carried among servers and users over a mainly- 
wired infrastructure. Meeting the deadline requirements of these 
packets with an efficient use of resources requires a careful 
design of schedulers that decide on how and when data should 
be transferred over the network. Due to the large volume of 
data, the complexity of schedulers should be kept low to reduce 
the amount of energy consumed by these data centers. To that 
end, our objective is to develop a low-complexity and provably 
efficient scheduler and an associated admission controller for 
deadline-constrained data. 

On-line packet scheduling has been a widely-studied prob- 
lem. Since the seminal work in [1], various versions of the 
problem for single hop systems have been considered. It has 
been shown that EDF has the same performance as the optimal 
off-line algorithm [1, 2] for the scenario in which the system is 
under-loaded. When considering over-loaded arrivals (i.e., the 
case when even the best off-line policy drops some packets), 
there is the additional question of whether the controller needs 
to decide to accept or reject a packet upon arrival time, 
i.e., admission control. With the constraint that the admission 
controller and the scheduler do not have to decide on a 
packet's admission into the system and the period that it is 
scheduled upon arrival time, it is shown in [3] that | is the 
best competitive ratio among all on-line algorithms and an 
online algorithm is provided [4] to achieve this ratio. With 
this constraint the problem is addressed in [5, 6]. In addition 
to immediate decisions, the model studied in [7] imposes a 
penalty on the unfinished workload, and the authors propose 
an on-line algorithm with competitive ratio 3 — 2^/2 and 
show that this ratio is the best achievable ratio for all on-line 
algorithms. Within the single hop setting, similar problems of 
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packet scheduling have been studied in [8-12] for the scenario 
with parallel processors, where the controller needs to decide 
which machine to process each packet as well as scheduling and 
admission control. An on-line algorithm requiring immediate 
decision upon packet arrival time is proposed in [9] with an 
asymptotic competitive ratio It is later shown in [10] 

that this ratio is the maximum achievable ratio for any on-line 
algorithm. In [11, 12] a penalty-based model is introduced for 
unfinished workload and competitive ratios were derived for 
various algorithms. 

All of the works mentioned above require continuous pro- 
cessing of packets, i.e., each packet can be processed, paused, 
and restarted at any point in time preemptively. In [13], a slotted 
single queue system is considered in which all packets have 
unit length and uniform weights, and it is shown that EDF 
has the same performance as the optimal off-line algorithm. 
In [14, 15], the same discrete model is considered with packets 
having heterogenous weights and it is shown that the achievable 
competitive ratio is within [0.5, v ^,~ 1 ]. Furthermore, it is shown 
that the lower bound 0.5 is achieved by the largest weight first 
policy and a lex-optimal scheduling policy is provided. 

There have also been a few works that have investigated the 
problem of scheduling packets with deadlines in the multihop 
setting. In [16], the authors investigate the problem of online 
scheduling of sessions with known injection rates, given dead- 
lines and fixed routes. They first give a necessary condition 
for feasibility of sessions and then propose an algorithm under 
which most sessions are scheduled without violating the dead- 
line with high probability when the necessary condition for 
feasibility is satisfied. The algorithm they proposed is called 
coordinated EDF. The main idea of coordinated EDF is to 
assign virtual deadline within certain region (that is related to 
the session parameters such as injection rate, the actual arrival 
time and deadline) for the first hop of each packet uniformly 
at random, and then assign virtual deadlines of the remaining 
hops based on the virtual deadline of first hop regulated by 
constants that are related to the session parameters. Upon 
packet scheduling for each link, the packet with earliest virtual 
deadline of the hop index at that link is transmitted. In [17], 
it has been shown that a modified version of EDF achieves 
the same performance as the optimal off-line algorithm for 
any arrival sample path over an uplink tree with uniform link 
capacities and packet weights. 

In the first part of our paper, we consider under-loaded 
arrivals but allow links to have heterogenous link capacities 
and show that EDF has the same performance as that of the 
optimal off-line algorithm. In the second part, we consider a 
general multihop network, where simple heuristics such as EDF, 
minimum number of remaining hops first, minimum remaining 
time till expiration first, or Largest Weight First do not have 
provable efficiency. Achieving provable efficiency in a general 
network topology requires a joint consideration of the factors 
such as deadlines, packet weights, and path lengths etc. Our 
approach to the problem with the general multihop topology is 
motivated by competitive routing in virtual circuit network [18]. 



In the competitive routing model, link bandwidth is the resource 
to be allocated. By viewing the time slots as resources, the 
packet scheduling problem can be transformed into a resource 
allocation problem. Our approach has a couple of fundamental 
differences with the one in [16]. Firstly, our scheme is not based 
on the prior knowledge of the packet injection rates, as is the 
case in [16]. Secondly, we investigate both under-loaded and 
over-loaded arrivals, whereas in [16], the authors study under- 
loaded arrivals. 

To summarize our main contributions in this paper: 

* We show that EDF has the same performance of the 
optimal off-line algorithm under an uplink tree with het- 
erogenous link capacities for any under-loaded arrivals. 

« We develop a competitive ratio based admission control 
and packet scheduling framework that has low complexity 
and is 0{Pm log Pm) -competitive 2 where Pm is the max- 
imum route length among all packets, under general multi- 
hop network topologies and arrival samples. Moreover, we 
show that no online algorithm can achieve a performance 
scaling better than 0(Pm logPji/). 

II. Problem Statement 

We study the packet scheduling problem with hard deadlines 
in a general multihop network topology represented by a 
directed graph, as shown in Fig. 1. We assume a time slotted 
system. The arrival sample path consists of K packets, where 
each packet i 6 {1, 2, ... , K} (the packet set is indexed in the 
order of arrival times of the packets) is associated with four 
parameters (a,i,di, pi, Pi). Here, and d% are the arrival time 
and the deadline, respectively, both of which are given in slot 
indices (important notations are summarized in Table I). We 
allow each packet i to have a weight p;, which is an arbitrary 
real number that represents the importance of the packet. We 
assume that each packet i is routed through a predetermined 
path 3 Pi from its source node to its destination, where Pi 
denotes the set of links through which the packet traverses in 
order. We assume infinite packet buffers at all nodes. If packet 
i is still at a non-destination node by the end of slot di, then its 
timer expires and it is deleted from the network. Note that the 
arrival sample consists of finite number of packets, when all 
packets have finite deadlines, the packet queues in the network 
will always remain bounded. We assume that each packet has an 
identical (unit) length and each link in the network can serve an 
integer number (possibly different for different links) of packets 
at a given time slot. 

We let p denote a service policy that specifies the packets to 
be transmitted over each link and the packets to be admitted 
to the system. We then define the indicator function for any 
policy p, to identify whether a packet reaches its destination 

2 0(a;)-competitive means the competitive ratio goes to at least as fast 
as £ — > oo. 

3 Our framework can be generalized when there are multiple candidate 
routes to choose. 
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TABLE I 
List of Symbols 



K 


number of packets 


a i 


arrival time of packet i 


dj 


deadline of packet i 


Pi 


weight or packet i 


Pi 


routing path of packet i 


1? 


indicator of packet i being successfully received under policy p 


RP 


revenue of policy p 


r p 


competitive ratio of policy p 


Si 


average slack time per hop for packet i 


Hi, 3) 


indicator of packet j using unit resource of packet i 




cost of packet j using unit resource of packet i 


Si 


maximum possible per hop delay of packet i 


h{i,i) 


indicator of packet j may use unit resource of packet i 


MO 


hop index of link I in the route of packet i 




reserved time slot fore transmission at link I for packet i 



within its deadline as: 

1 if i reaches its destination before the end of cb 



1 



otherwise 



(1) 



and the weighted revenue gained by the successfully received 
packets as: 



R p = E p^- 

i£{l,2,...,K} 



(2) 



Let CP on ii ne be the set of online policies. Our objective is to 
solve 



max BP. 

pG^online 



(3) 



packet 




Fig. 1. General Network Topology with Multiple Source-Destination Pairs 



III. Motivating Example 

An optimal off-line algorithm is one that has the entire 
arrival sample path available non-causally and finds a schedule 
with maximum revenue among all algorithms. The optimal off- 
line algorithm is a conceptual tool, which is typically used 
as a measuring standard against which the performance of 
online algorithms can be compared. This is typically used in 
competitive ratio literature. The competitive ratio r p of an on- 
line algorithm p is defined as the minimum ratio of the achieved 
revenue for the on-line algorithm to the revenue of the optimal 



off-line algorithm, where the minimization is over all possible 
arrival patterns: 

R p (v) 



vev R° mine (v) 

Here, R p (v) and R° mme (v) are revenue of online algorithm p 
and optimal offline algorithm under arrival sample v, respec- 
tively. V denotes the set of all possible arrival samples. 

In this section, we provide an example that shows that (1) 
on-line scheduling with deadlines is a difficult problem, and 
(2) even for very simple topologies, there may exist no on-line 
policy that achieves the performance of the optimal off-line 
algorithm (i.e., we show that the competitive ratio < 1). This 
is even valid for feasible arrival patterns (i.e., arrival patterns 
such that all packets can be served by their deadlines by the 
optimal offline algorithm), as we will illustrate in this example. 

Example 1: Consider a line network 1 — > 2 — > 3 and 
suppose that the link capacity of each link is 1, as shown in 
Fig. 2. Initially at node 1, there are two packets k\ and k^ with 
deadline d\ = 2, d^ = 4 whose destinations are node 2 and 
3, respectively. Suppose that node 1 transmits k\ to node 2 in 
time slot 1, and that there is no arrival by the end of slot 1, 
then node 1 transmits /c2 to node 2 in slot 2. Let an "adversary" 
inject a packet k$ at node 2 by the end of slot 2 with deadline 
dz = 3 whose destination is node 3. Then, node 2 transmits 
kz to node 3 in slot 3. Further let the adversary inject a packet 
£,•4 at node 2 by the end of slot 3 with deadline d& = 4 whose 
destination is node 3. Then, by the end of slot 4, either k^ or 
k^ expires. However, this arrival sample is feasible since the 
off-line algorithm transmits ki in slot 1 and all four packets are 
able to reach their destinations within their deadlines. Similarly 
if node 1 transmits k<i to node 2 in time slot 1 . Let the adversary 
inject a packet k^ at node 1 by the end of slot 1 with deadline 
d-i = 2 (whose destination is node 2). Then, by the end of 
slot 2, either k\ or k-$ expires. However, this arrival sample is 
also feasible since the off-line algorithm transmits k\ in slot 1 
and all three packets are able to reach their destinations before 
their deadlines. This means that under this scenario, no matter 
what online decision node 1 makes in slot 1, the adversary 
can always chooses future arrivals so that the online decision 
is worse than the optimal off-line algorithm even though the 
entire arrival sample is feasible. 

One of the main conclusion one can draw from this example 
is that, there may exist no on-line algorithm that achieves 
the same performance as an optimal off-line algorithm even 
for simple network settings. This motivates our study for 
developing online algorithms that have a provable (non-zero) 
competitive ratio, relative to the optimal off-line algorithm for 
a general network topology and arrival patterns. In the rest of 
this paper, we begin with a scenario under which there exists 
an online algorithm that achieves the same performance as the 
optimal off-line algorithm. We provide such an algorithm. We 
then develop an online algorithm that is provable efficient for 
a general multihop network. 
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On-line Algorithm 

(=1 




d, =2 



Off-line Algorithm 



th -4 K ^ l *\fo=* 




Alternate On-line Algorithm 
t=l 




(a) 



„ adv. 



Off-line Algorithm 





(=3 



3 W 



(b) 



t=3 



th -4 ^ J ih -4 

-5"U=4 




Fig. 2. An example of packet scheduling with deadlines in a line network. Four time slots are considered for two alternate sample paths. The deadline is marked 
in the packets and the destinations are marked with matching coloring between the packets and the nodes. The two sample paths illustrate that, no matter how 
an on-line algorithm schedules packets, there exists an arrival sample path that leads to a suboptimal selection with respect to the optimal off-line algorithm. 



Note that, there are other topologies for which there exists no 
on-line algorithm with a competitive ratio identical to 1 such 
as: 

• Down-link tree (destinations of all packets are leaves of 
the tree and source nodes can be any other nodes) even 
with identical link capacities and under-loaded arrivals 

• Line network with multiple flow destinations even with 
under-loaded arrivals 

• Uplink tree (destination of each packet is the root of 



the tree and source nodes can be any other nodes) with 
various link capacities and overloaded arrivals. 

The details of all three of these examples can be found in 
Appendix C. 

IV. Optimal Packet Scheduling in Uplink Tree 
Networks with Under-Loaded Arrivals 

While it is not possible in most cases for an on-line algorithm 
to match the performance of the optimal off-line algorithm, 
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in certain cases this is indeed possible. In this section, we 
specify such a case and find the optimal on-line algorithm with 
a competitive ratio of 1. In particular, we consider an uplink 
tree network as shown in Fig. 3. Each packet i arrives at an 
arbitrary non-root node in slot a; and is destined to the root 
through multiple hops within its deadline di. For under-loaded 
arrivals, the packet weights are not important since an optimal 
algorithm serves all packets anyway. Without loss of generality, 
we assume that all packets have the same weight, then our 
objective reduces to maximizing the throughput, i.e., 



max BP 



max 



se{i,2,... 



If. 




packet k 



serves packets with non-negative slack times in each slot 
achieves the same performance as the optimal off-line algorithm 
in maximizing the throughput. 

This theorem, proven in [17], is for an uplink tree with 
identical link rates. In the following theorem, we extend the 
result to the scenario where links may have different rates (as 
long as they are integer number of packets/time slot) for under- 
loaded traffic. 

Theorem 2: For an uplink tree with possibly different link 
capacities that are integer number of packets per time slot, for 
all under-loaded arrivals, the WC-EDF policy ensures that all 
packets reach their destinations before their deadlines. 

The detailed proof of Theorem 2 can be found in Ap- 
pendix B. Theorem 1 holds for identical link capacities and its 
proof is based on induction on links. Since Theorem 1 does 
not hold for heterogeneous link rates, the proof techniques 
for Theorem 2 are fairly different from those in Theorem 1. 
Theorem 2 is proven by a careful classification and analysis of 
all possible arrival sample paths. 

Theorem 2 shows that under WC-EDF, all packets for any 
under-loaded arrival sample path reach their destinations before 
their deadlines and hence generates the same throughput as the 
optimal off-line algorithm. Note that a biproduct of Theorem 2 
is that it can be used to test whether an arrival sample is 
feasible. 



Fig. 3. An Uplink Tree 

Definition 1: The slack time of packet i in time slot t £ 
[di, di] is equal to di — t — hi(t) + 1, where /i;(£) is the number 
of hops from the node at which packet i resides in time slot t 
to the destination of i. 

The slack time can be viewed as the extra time that the packet 
has above the minimum remaining time needed for a packet to 
reach its destination. 

Definition 2: Policy p is called a work-conserving packet 
scheduling policy if it keeps each link fully utilized in each time 
slot, as long as the queue feeding the link contains sufficiently 
many unexpired packets. 

Lemma 1: For any non-work-conserving policy, there exists 
a work conserving policy that achieves an identical or a higher 
throughput under any given arrival pattern. 

The intuition behind Lemma 1 is fairly clear, since non-work- 
conserving policies unnecessarily waste resources. The detailed 
proof can be found in Appendix A. From Lemma 1, we only 
need to focus on work conserving packet scheduling policies 
to solve the problem, i.e., max p R p = max pe e R p , where C is 
the set of work conserving packet scheduling policies. 

Definition 3: A work conserving earliest deadline first (WC- 
EDF) policy is one in which each node transmits the largest 
possible set of packets that the link capacity allows with the 
earliest deadlines among all the packets in its packet queue. 

We next state a result on WC-EDF from [17]. 

Theorem 1: [17] For an uplink tree with identical integer- 
valued link capacity, given any arrival sample path (either 
under-loaded or over-loaded), the WC-EDF policy that only 



V. Competitive Packet Scheduling for General 
Topologies and Arrival Patterns 

In this section, we focus on a general network topology (e.g., 
that shown in Fig. 1). We will propose a scheduling strategy, 
evaluate its performance, and show that the performance of our 
strategy is order optimal, i.e., no on-line algorithm achieves a 
better scaling law for the competitive ratio, in terms of the 
maximum route length. 

For any link I € Pi, let hi(i) denote the hop index in the 
route of packet i. For ease of notation, in this section, we 
present the main results for the case in which all the links 
have unit capacity 4 . We allow packets to have different weights 
Pi, i = 1, 2, . . . , K, and our objective function is as stated in 
Equation (3). 

Upon the arrival time of each packet into the network, the 
controller of its source node decides whether to accept or reject 
this packet. If there are multiple packets arriving at the network 
in the same time slot, we assume the controllers of different 
packets make decisions at different instances (in the same time 
slot) in the same order as the packet index. If packet i is 
accepted, then each link I e Pj needs to reserve a time slot so 
that packet i will be transmitted through link I in this reserved 
slot. The reserved time slot is not changed in the subsequent 
time slots. Let £;(7) denote the index of this reserved time slot 
in which packet i is transmitted through link I € Pi if i is 

4 Our results can be generalized when link rates C'i are distinct, as long 
as there are an integer number of packets per time slot by replacing s-i with 
CiSi in Equation (6), (7), (8), and in the definition of Costj in Algorithm 1. 
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accepted. Define for any i,j,l the following indicator 

[" 1 if packets i,j are accepted; I £ Pj, I £ Pf, 



where 



tj(l) £ [di + (h[(i) - l)S(,Oi + hi(i)si - 1] 



otherwise 



dj-aj + l 

IPI 



(4) 



(5) 



is the average slack time per hop for packet i with |P;| as the 
number of total hops on its route. Note that di — a.j + 1 is 
the maximum allowable end to end delay for packet i in the 
network. If we divide this delay evenly on each hop, then s, is 
the maximum allowable delay on each hop and [a.j + (foj(i) — 
i)si,Oi + hi(i)si — 1] is the set of time slots that i can use to 
be transmitted through link I, From another perspective, a time 
slot can be viewed as a resource and [a; + (hi(i) — l)s;, a, + 
hi(i)si — 1] is then the set of available resources for packet i 
and Si is the total amount of resources at each link on the route 
of i. When both i and j are accepted and link I is in the route 
of both i and j, if the reserved transmission slot of j takes one 
resource in i's resource set at link I, then the indicator 
becomes 1 . This means packet j consumes one unit of resource 
of packet i at link I. 

We define the cost (the exponential cost metric is motivated 
by [18]) of packet j taking a resource of i at link I as 



l) 



(6) 



where (i is a control parameter (we will discuss how to choose 
the value of /i, later in this section) and 

Ii(i,m) 



Mm) = E 



(7) 



is the fraction of packet i's resources that have already been 
taken before arrival of packet j at link I. By letting Xi(i, 1) = 
for all i, I, we have the following recursive relationship: 



X l (i,j + l) = Xi(i,j) + 



Si 



(8) 



i.e., Xi(i,j) and thus ci(i,j) is increasing in j for any given i 
and I, This is to be expected, since the packet arrival sequence 
is indexed in the order of arrival times of packets, so a later j 
should result in giving more time for packet i to consume of 
of its resources. 

Before describing our algorithm, we further need to define 
for i 7^ j that 

1 the intersection of the intervals 

a j + h i(j) ~ Mj - \Pj\ + hi(j)] and 
a, + (hi(i) - l)si, a, + hi(i)si - l] 
are nonempty; I £ Pi, I 6 Pf, i is accepted 
otherwise 

(9) 



and 



liUJ) = h Vj, lePf 



(10) 



Note that [ai + hi(i) — 1, di — \Pi\ + hi(i)] is the range of time 
slots that packet i can possibly remain enqueued in the queues 
of link I for it to reach the destination before its deadline under 
any algorithm. Define 



S{ — d<i 



IPI+2 



(ID 



to be the maximum possible delay of packet i at each link 
I £ Pi and it is easy to see that s», the amount of resources 
at each link on the route of i is less than Si, i.e., Sj < Si 
for all i. Variable indicates whether packet j may take 

a resource of packet i under any possible scenario. Note that 
ti(j) £ [aj + - l,dj - \Pj\ + hi(j)] for all I £ P, 
for any scheduler, since allocating any time slot out of this 
interval to transmit j over I £ P, will lead to the expiration of 
j. Hence, one can see that < hihj) f° r a U hj>l from 

Eqs. (4), (9), and (10). 

Algorithm 1 Admission Control and Packet Scheduling 
Upon arrival time of packet j, let Costj := 

1) If Costj > pj, then reject j; 

2) If Costj < pj, then accept j and let ti(j) be the empty time 
slot with the largest index in [aj+(hi(j)—l)sj,aj+hi(j)sj — l]. 
Put packet j into ti(j), V/ £ Pj-, 

3) Any accepted packet j is transmitted through link I £ Pj at 
time slot ti(j). 

Our admission control and packet scheduling algorithm is 
described in Algorithm 1 . Note that from Equation (9), we have 



A L-ii<j Si c l(hJ) — A^lePj £^i<j 

calculation only needs information on the route of packet j. For 
each I £ Pj, the calculation of the term J2i<j c i(h j) on ly 
requires the information of packets that may route through link 
I. It is also easy to see that the calculation of the cost term does 
not require future information for times after the arrival time 
of each packet j, i.e., Algorithm 1 is an online algorithm that 
uses only causal information. Furthermore, Xi(i, j + 1), i < j 
is calculated from Xi(i,j) using Equation (8) when packet j 
is processed by Algorithm 1, and Equation (7) is only used to 
calculate Xi(j,j) upon j's arrival. The transmission slot at each 
hop is determined when the packet is admitted. 

The basic intuition behind our algorithm is simple: We 
rst allocate the end-to-end delay of each packet evenly over 
the links along its path. The algorithm then schedules the 
transmission for an accepted packet in a slot within its allocated 
time region at each link. Consequently, the end-to-end deadline 
constraint is met. With this approach, the natural questions are: 
(1) When a packet j is accepted, is there always an empty (non- 
reserved) slot in [aj + (hi(j) — l)sj,aj + hi(j)sj — 1], VZ £ Pj 
so that we can reserve a slot U(j) for j at link 11 (2) What 
is the performance of Algorithm 1 compared to the optimal 
off-line algorithm? We answer these questions in the following 
theorem. We denote the competitive ratio of our algorithm with 
r, i.e., R > rR*, where R is the worst-case (over all sample 



E^p.E^^KU), i-e-, the 
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paths) weighted revenue achieved by Algorithm 1 and R* is the 

weighted revenue achieved by the optimal off-line algorithm. 

Theorem 3: If the system parameters satisfy Pm < 

2 m , 7 A j r , where Pm = max; \Pi\ is the maximum route 
2sm \~) 

length, s rn = min; s; is the minimum average slack time, sm = 
max; Si is the maximum average slack time, p m = min; p; 
is the minimum weight and pm = max; pi is the maximum 
weight among all packets, then every packet accepted by Algo- 
rithm 1 reaches its destination before its deadline. Furthermore, 
Algorithm 1 achieves competitive ratio r = ^2{2(smPm + 1) + 

1) (1 + ZM-s M ) log (2f±s M P M + 1 + e) + l] ~\ where e > 
is an arbitrarily small constant. 

Hence, our algorithm is 0(Pm log PM)-competitive when 
the condition of Theorem 3 is satis ed, where Pm is the 
maximum route length. The assumption Pm < 2 m , 7 M 

in Theorem 3 imposes an upper bound on the maximum 
route length Pm for the validity of the provided competitive 
ratio. According to the condition, Pm is upper bounded by 
an exponential function of the minimum average slack time 
s m . Despite the fact that the competitive ratio is valid only 
when the condition is met, in Section VI, we will illustrate 
using numerical examples that our algorithm achieves a high 
performance relative to the optimal off-line algorithm, even 
when this condition is not satis ed. 

To prove this theorem, we rst make the following trans- 
formation. With condition Pm < 2 7 7 M 'i ■ we can c h°° se 
p so that log(/i) < s m and p > 2 Em -smPm + 1 > 1, 
i.e., > ^sm > sm- Then, we choose a factor, 

F e ^ 2P *' SM , t^f), and normalize the weights pi for all i 
with factor F and use Fpi, instead of p; for all i in the problem 
(the objective is still equivalent to the original one). With this 
change, we have log(p) < s m < s M < jp^ < jp^- < §p^, 
i.e., 

log(M) log(M) 
2\Pj\sM < 1P m sm < pm < Pj, for all j; (13) 
pj < Pm < P - 1, for all j. (14) 

We now provide the following sequence of lemmas to prove 
Theorem 3. First, we prove that, if a packet is admitted by 
Algorithm 1, than it is successfully served within its deadline: 
Lemma 2: Under the same condition of Theorem 3, if j is 
accepted by Algorithm 1 , then there exists at least one time slot 
in the interval [a,j + {hi(j) — l)sj,a,j + hi(j)sj — 1] that has 
not been reserved by other accepted packets for each I £ Pj. 
Proof: Suppose j is the rst packet that is accepted by 
Algorithm 1 but there exists I 6 Pj so that all time slots in 
the interval [cij + {hi(j) — l)sj,aj + hi(j)sj — 1] are occupied 
by other accepted packets when j is accepted. From Eqs. (4) 
and (7), we have Xi(j,j) = 1 and ^f^- = p x '^^-l > p-1. 
Note that = 1 by Equation (10), combined with 



Equation (14), we then have 

V i'<3 

> ci(j,j) = > fi- 1 > pj, 

s j s j 

i.e., j is rejected by Algorithm 1 which is a contradiction. ■ 
Then, we nd an upper bound on the difference between the 
weighted revenues achieved by the optimal off-line algorithm 
and by our algorithm: 

Lemma 3: Let Q denote the set of packets that are rejected 
by Algorithm 1 but successfully received by the optimal off- 
line algorithm, then E,- 60 Pj < ( 2 ff + l ) EiEt 
under the same condition of Theorem 3, where K is the last 
packet of the arrival sample. 

Proof: For any j g Q, from Algorithm 1 and the fact that 
ci(i,j) is increasing in j, given any i and I, i.e., ci(i,j) < 
ci(i, k), V/, i if j < k, we have 

1 i s * 

Consider any packet i and any link I 6 Pi, if i is rejected 
by Algorithm 1, then = 0, Vj 7^ i and = 1, we 

then have EjeQ ^-7^ < 7-; otherwise, we have = 1 

only for j with a, + (hi(i) — l)sj < dj — \Pj\ + hi(j) and 
a,j + hi(j) — 1 < Oj + hi(i)si — 1. Let be the time slot 
in which packet j is transmitted through link I e Pj under 
the optimal off-line algorithm. Note that t*(j) € [a 3 - + hi(j) — 
1, dj — \Pj\+hi(j)] since this interval is the maximum allowable 
transmission interval for the successful reception of j under all 
algorithms. Furthermore, if t* t (j) < Oj + (hi (i) — l)s, — Sj + 1 or 
ti(j) > ai+h[(i)si — l+Sj — l, then it means dj — \Pj\+hi(j) < 
*r0')+ s i- 1 < a l +{hi(i)-l)s l OTaj+hi(j)-l>t* l (j)-Sj+ 
1 > di + hi(i)si — 1, i.e., = 0. Therefore, we must have 

t*U) e [cH + ihiiil-fyi-Sj + lyCH + hiityi-l + Sj-l] if 
= 1, then EjeQ J ' g.^ < 2Si "^ s '~ 2 . By summing over 
all j e Q and combining with the fact = 0, V7 ^ Pi, 

we have 

where Sm = max; Si is the maximum link delay among all 
packet and s m = min; s; is the minimum average slack time 
among all packets. ■ 

Finally, we derive a lower bound on the achieved weighted 
revenue by our algorithm: 

Lemma 4: Let A denote the set of packets that 
are accepted by Algorithm 1, then J2i2~2i c i(h ^0 — 
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2 ^1 + sm^-^ log(p) 12j^A Pj un der the same condition of 
Theorem 3. 

Proof: Note that for any I, i and j £ A, we have 



ci(i,j + 1) 



Cl (i,j) = s t p x '^(p 



ci{i,j) 



+ l)Ii(i,j)\og(p), (15) 



where the inequality is from Equation (12) and the fact 2 X — 1 < 
x, x £ [0, 1]. The last equality is from Equation (6). 

Recall that < Vi,j,Z by Equation (4) and 

Equation (9); ci(i,j) < ci(i,i), V« > j by Equation (6), 

Equation (8) and Equation (4); and 2i2i<y / 'g' J ' ) Q(», j) < 
Pj, Vj £ A from Algorithm 1. From Equation (4), we 
have Yljiihj) = J2ieA I d i J)^ v i e A From Lemma 2, 
G K + (hid) ~ l ) s i, a i + hi{i)si - 1] for any i £ A. 
Note that in order to have = 1, we must have 

a-i + (hi(i) — l)si < ti(j) < ai + hi{i)si — 1. For any i £ A, 
if ti(i) < ti(j) — Si + 1 or ti(i) > ti(j) +Sj — 1, then it means 
ai + hi(i)si-l <ti(i) + Si-l < ti(j) or at + (hi(i) - l)s, > 
ti(i) - Si + 1 > i;(j), i.e., = 0. Therefore, if = 

1, Vi £ A, then t;(i) € [U(j) - Si + + s 4 - 1], i.e., 

Ei£i4(i,j) = EjE^fri) < 2|J>< < 2|P,-| SM < Pa- 
using Equation (13), and J2 ieA ^(*>i) < 2 ^ s «- For an y 
I, i and j £ A, by summing over I and i of Equation (15), we 
have 



EE 

l i 

< Iog(/u) 
< k>g(p) 



+ 1) - Q(i,i)] 



/ i it 
i i<,- Si 



< Iog(/i) 



ft+ E 



>j,ieA I 

h{i,j)=i 



£^M Ci(M) + 2 | P .| SM 



< log(p) 

< log(p) 

< log(M) 



«+ E EE^ c <(m+2|^| S m 



^ + ^E7 1/i ( 4 ^') + 2 l P 'l s 
Pi 



ie.A 



, O ^ M olD 

Pj + 2s M Pj + 2\Pj\SM 

Pm 



<2 ( 1 + s M — ) log(/x)pj, 



and combined with a(i, j + 1) — ci(i,j) = 0, Vj ^ A, we have 

EE c >( i ' ir ) = EEE[ c '( i 'j +1 )- c '( i >j)] 

l i I i j 

=EEEh( i >i+ 1 )-°'( i >i)] 
- logMEft- ■ 



<2 1 



jG.A 

Pm 



sm 



Pm ) 



j€A 



Proof of Theorem 3: From Lemma 2, we see that for every 
accepted packet j, there exists an unreserved time slot ti(j) in 
the interval [a,j + (hi(j) — l)sj, ai + hi(j)sj — 1] for transmission 
at any I £ Pj. With this allocation of the total slack time on 
each hop, it is apparent that j can reach its destination before 
deadline dj, if it is transmitted over link I in slot ti(j) for all 
I £ Pj, which is indeed the case for the admitted packets. 

Lemma 2 proves the rst part of the theorem. The remaining 
part of the theorem is proved in two steps: Combining Lem- 
mas 2, 3 and 4, we have 

R* <E^ + E^ 

jSQ j€A 

Sm J I i jeA 



2^ + 1 
2^ + 1 



l + SM— )l0g(/x) 



1 + s M — ) log(p) 



E Pi 

j€A 

r 



Note that s rn > 1 for a slotted system. From Eqs. (5) and (11), 
we have Si < (si+l)\Pi\ -|Pj| + l < s ; |P ; | + l and then S M < 
s&iPm + 1. Recall that p > 2^s m Pm + 1- By letting p = 
Z^-smPm + 1 + e, where e > can be arbitrarily small, we 

haver > [2(2(s M P A/ + l) + l) (l + ^,s M ) log (2^,s M P M + 



1 + ej + lj , which is identical to the competitive ratio r. 
Hence, our algorithm is 0(Pm log PAf)-competitive. ■ 

Theorem 4: In a general multihop network topology 
with general arrival samples, all online algorithms are 
Vl(Pm log PM)-competitive. 

Proof: Consider a line network with Pm links l\,...,lp M and 



a sequence of packets that consists of s m Pm log [^^smPm 
phases, where Pm is the maximum path length, p^j is the 
maximum packet weight, p m is the minimum packet weight, 
and sm is the maximum average slack time. Assume j^smPm 
is a power of 2 and each link has unit capacity. Each phase 

i £ [l,s M P M log(^s M PM)} has [-i^-2 L ^ J l 



each group j £ \1, \ Pm 2 ^ 'm' j 
groups, and each mini group 



ri- 



nds r^2 L 

1 PM 

A 



groups, 

2 p77 J i ■ ■ 

| mini 

J- 



L- 



-J 



£ \1, r^2 "m p m 11 has 
packets. A packet in phase i group j mini 



r£m 2 B M^M 1 
PM 1 

group k has link I 



1 as its rst hop link, 



r £m_ 
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as its last hop link, 



smPm 



1 PM 1 



as its 



Pm log( ^sm-Pm) — 1 to obtain weighted revenue 



Pm 



" ^ i j U — 1) + (k — 1) ratio is bounded by 



PM S M 

end-to-end delay, and 1-1 — 

r Pm 2 *m^m 1 

PM S M . 

as its arriving time slot. Then, it is easy to see that the 
maximum average slack time is sm and the maximum path 
length is Pm- Let all packets in phase i have the same 
weight pi. Note that weight pi is obtained in phase i by using 
resources, then a unit weight is gained by 



that is larger than jPmSmP, 



Pm 
L- 



-J 

-2 'M^M ] 



using — ■ 

6 Pi 



resources. 



r Pm 2 s m^m n 

PM S M 

Let be the weighted revenue obtained by the online 
algorithm from packets in phase i. Since there are SmPm time 
slots and Pm links in total, we have smPm ^ me resources. 
Therefore, 



E 



Pi r_£n^ 2 L; I^ J l 

I D A.r ft aa 



<s m Pm- (16) 



De ne Fj 



i 



Pa/ 



Pi 



-J 



X)j = i x h then 



CM S M 
S M P A/ log(^- SM PA/ 



2 a M^M ] 



E 



j=i 

4rP M log(fM. SM P M ) 

E 

j=i 

4 f p A/ io g (^ s „p„) 



M 



3 



P.l 



2 Ls m' p »/ J ] i=l 



< 



E 



-J- 



1 PMSM 1 



<2s M P M! 



where the last inequality is from Equation (16). This means 
there exists fc e [1, s M P M ^(^-sm-Pm)] so that F fe < 

and then the weighted revenue of online 



S 2 M PMlog(^S M PM) 

algorithms 



E^ 



Pk\ 



PMSM 



-Fk (by de nition of Fk) 



< 



^ K 1 Pmsm 1 



2s M P M 



2smPm 



- Pfe S 2 /PA/log( £M SM p M) 



We rst let 



if fc^ 4 / p M io g (^i SM p 



let p 



s ^P M log(^- SM F M ) 



then 

Pm- The off-line algorithm can 



simply serve packets in phase s m Pm log(^ M - SmPm) to obtain 
weighted revenue pmsmPm'' If k = s 2 M P M \og{^ s M P M ) , 
then let Ps1[Pm M £it llfftf) _i = Pa/- The off- 
line algorithm can simply serve packets in phase 



M . Therefore, the competitive 

f^s 2 M P M \og{^s M P M )\ which is 
in the same order of r and the optimal online algorithm is 
0(Pm log Pm) -competitive. ■ 

Consequently, our algorithm is order optimal in competitive 
ratio when the condition of Theorem 3 is satis ed. 

Our competitive ratio based framework of packet schedul- 
ing with deadlines is motivated by the competitive routing 
model [18]. In [18], link bandwidth is the limited resource 
and the algorithm decides whether to admit and route packets 
according to the available link bandwidth along the path so 
that the throughput can be maximized. However, there are 
signi cant differences between the two models: 1) The amount 
of link bandwidth is xed and known at the beginning for 
wireline networks in the competitive routing model [18], but the 
time slot resources are related to the accepted packets (arrival 
time and deadline) and are then related to the algorithm itself 
(since the available time resource is related to the previously 
accepted packets by the algorithm); 2) A packet that arrives 
after the current accepted packet may get admitted and share 
overlapped routing hop and time slots that would be available 
to a potential packet arriving later. Thus, we treat a time slot as 
resources to be shared between packets. In an on-line algorithm, 
current decisions can in uence future decisions, which make it 
dif cult to develop such algorithms; 3) There are multiple ways 
of allocating the total end-to-end delay dj — aj + 1 (slack time 
from arrival time to deadline) of each packet j on each hop, 
which brings further complexities to our problem. 



VI. Numerical Examples 

We rst consider an uplink tree shown in Fig. 4(a) with 
identical link rates. There are 10000 packets, also with identical 
weights, and the inter-arrival times of packets are chosen 
to be w.p. | and 1 time slot w.p. i. We generate the 
initial slack time (the difference between the deadline and 
the arrival time, increased by 1) uniformly at random be- 
tween 24 and 30. The source node of each packet is chosen 
uniformly at random over all non-root nodes. It is easy to 
see that the maximum route length Pm = 3 for all packets 
in this network. Thus, the maximum average slack time is 
sm = 30 and the minimum average slack time is s rn = 8, 



i.e., P, 



A I 



3 < 



4§p As given in the proof of 



Theorem 3, we choose the control parameter log(p) = 7.5 so 
that log (2^-smPu + l) = 7.4 < log(p) < s m = 8. From 
Fig. 5(a), we can see that by increasing the normalization factor 
of the packets' weight, the performance of our online algorithm 
increases and it achieves a revenue, larger than 90% of the 
revenue achieved by the off-line algorithm (the performance of 
the optimal off-line algorithm is obtained using the algorithm 
in Theorem 1). Since the arrival sample is close to under- 
loaded in this example, admission control is unnecessary for 
most packets. By tuning the normalized weight so that it is large 



10 



enough for the admission controller to admit almost all packets, 
better performance of the online algorithm can be obtained. 



Similarly, for another choice of slack times, generated uni- 
formly at random between and 5, the condition Pm < 




23 27 31 35 39 




Fig. 4. Example topologies: (a) An Uplink Wired Tree, and (b) A General 
Wired Mutlihop Network with Multiple Source-Destination Flows (c) A Wired 
Grid Network 

Next, we consider the (general) topology shown in Fig. 4(b). 
There are 10000 packets and the inter-arrival times of packets 
are chosen to be w.p. \ and 1 time slot w.p. |. The packet 
weights are generated uniformly at random between 1 and 100 
with ^ = 100. The given route Pi of each packet i is gen- 
erated in the setup stage as follows: the source node is chosen 
uniformly at random among all nodes, the outgoing link of each 
hop is chosen uniformly at random among all possible outgoing 
links, and at each hop, there is i probability to continue to 
next hop until reach the maximum route length 3. We rst 
generate the initial slack time uniformly at random between 45 
and 50 so that the condition Pm = 3 < 2 ",' - 1 >. = 2 ~» 

al r, , ( PM \ 10000 

is satis ed. Note that the region of the control parameter /.i 
satis es \og(2^s M P AI + l) = 11.55 < log(/x) < s m = 15 
in this example. With normalized packet weights (normalization 
factor is 300), we simulate the generated revenue as a function 
of log(/i). We see from Fig. 5 (b) that our online algorithm 



achieves a revenue that is the same as the upper bound of 
the optimal off-line algorithm (we compare our scheme with 
the revenue upper bound, i.e., the total normalized revenue, 
rather than the actual revenue of the off-line algorithm due 
to the extremely high complexity of the calculation of the 
off-line algorithm). Moreover, we can see that for values of 
log(/j,) G [0, 11.55) which is out of the region (11.55, 15], the 
online algorithm still achieves the same performance of the 
optimal of ine algorithm. The reason is that since this arrival 
sample is feasible (our online algorithm can serve all arrivals 
successfully as shown in Fig. 5(b)), the admission controller 
should admit all arrivals which is exactly the special case when 
log(/j,) = and the cost term of our algorithm is always zero. 

Similarly, for another choice of slack times, generated uni- 
formly at random between and 5, the condition Pm < 

2 m , -1 v is violated. Yet, our online algorithm achieves a 

revenue, larger than 80% of the upper bound with appropriately 
chosen log(/i). 

We now modi ed the inter-arrival distribution so that it is 
w.p. 0.8 and 1 time slot w.p. 0.2. For this more bursty arrival 
sample, we will see that the admission controller starts to take 
effect. From Fig. 5(b), it is shown that our online algorithm 
works best at log(/i) « 11.55 and it achieves around 90% of 
the performance upper bound. The performance decreases for 
either smaller or larger values of \x. 

From examples (a) and (b), we can see that the assumption 
Pm < rm ( ~l\ and the re S ion lo g( 2 ^7 s A/^M + 1) < 

loglW < s m of /i can be violated, the weight normalization 
factor is not necessarily used and the admission controller can 
be inactive. In practice, while the assumptions required in the 
proof of Theorem 3 are relaxed, the control parameters can be 
appropriately tuned for different scenarios so that our algorithm 
still has ef cient performance. 

Fig. 6 compare the performance of our online algorithm, 
EDF, LWF and the coordinated EDF algorithm introduced 
in [16]. In EDF, each link transmits the packet with the earliest 
deadline among the packets with nonnegative slack time every 
time slot. In LWF, each link transmits the packet with the 
largest weight among the packets with nonnegative slack time 
every time slot. The main idea of coordinated EDF (Section 2.2 
of [16]) is to assign virtual deadline within a certain region 
(that is related to the session parameters such as injection 
rate, the actual arrival time and deadline) for the rst hop 
of each packet uniformly at random, and then assign virtual 
deadlines of the remaining hops based on the virtual deadline 
of rst hop regulated by constants that are related to the session 
parameters. Upon packet scheduling for each link, the packet 
with earliest virtual deadline of the hop index at that link is 
transmitted. We use the general topology given in Fig. 4(b) 
for results in Fig. 6(a) and (b). We use the grid network given 
in Fig. 4(c) for results in Fig. 6(c) and (d). There are 10000 
packets and the inter-arrival times of packets are chosen to be 
w.p. 0.98 and 1 time slot w.p. 0.02 for results in Fig. 6(a) and 
(c). The inter-arrival times are exponentially distributed with 
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Fig. 5. Performance of Online Algorithm with (a) Different Normalized 
Packets Weights, and (b) Different log(/j) 



rate parameter 10 for results in Fig. 6(b) and (d). The packet 
weights are generated uniformly at random between 1 and 2. 
The given route Pi of each packet i is generated as previously 
described for topology in Fig. 4(b). For the grid network, the 
given route P; of each packet i is generated as follows: the 
source node is chosen uniformly at random among nodes 1-8, 
the outgoing link of each hop is chosen uniformly at random 
among all possible outgoing links, and at each hop, there is \ 
probability to continue to next hop until reach the maximum 
route length 5. We let all packets have the same initial slack 
time (end-to-end delay requirement) and we vary the slack 
time in our comparison. We can see that our online algorithm 
with carefully selected control parameters outperforms EDF, 
LWF and coordinated EDF in all scenarios. The revenues of 
all algorithms increase as the initial slack time becomes large. 

Finally, we consider a line network 1 — > 2 — > 3 — > 4 with 
four nodes and 3 links (identical link rates of 1 packet/time 
slot). The arrival sample is periodic with a period identical to 
6 slots. It is illustrated in the following table: 



slot 


1 


2 


3 


4 


5 


6 


packet 


{1,2} 


{3} 


{4,5,6} 


{7,8} 








di 


{6,1} 


(2) 


{3,5,4} 


{4,5} 


a 





(src,dst) 


{(1.4), 
(1,2)} 


{(1,2)} 


{(1,2), 
(2,4), 
(2,4)} 


{(1,2), 
(2,4)} 








Pi 


{100,90} 


{1} 


{1, 200, 1} 


{1,50} 








This arrival pattern repeats every 6 slots, until a total of 
10000 packets arrive. We use the normalization factor F = 12 
for the packets weights in the algorithm. It is easy to calculate 



the optimal weighted revenue i2§22 * (iqo + 90 + 200 + 50 + 
1 + 1) * 12 = 6.6 x 10 6 . We compare our online algorithm with 
EDF and LWF. Note that the condition P M < 2 ""'~ 1 \ is 



2s m 



PM 



already violated for this arrival sample. The revenues achieved 
by different schemes are summarized in the following table. 
We chose log(/i) = 10 for our scheme: 



algorithm 


proposed 


EDF 


LWF 


achieved revenue 


5.9 x 10° 


5.3 x 10° 


4.4 x 10° 



In this case, our algorithm outperforms EDF and LWF, and 
it achieves about 90% of the revenue, achieved by the optimal 
off-line algorithm. 

VII. Conclusion 

In this paper, we studied the packet scheduling problem with 
hard deadline constraints in multihop networks. We rst showed 
that, an on-line algorithm cannot achieve the performance of 
the off-line algorithm, even in most simple topologies. Then, 
we showed that this is not true for the uplink tree, and showed 
that WC-EDF has the same performance as the optimal off- 
line algorithm, given any feasible arrival sample path. We 
then proposed an on-line joint admission control and packet 
scheduling algorithm that requires only information on the route 
of each packet in the calculation, and has provable competitive 
ratio to the optimal off-line algorithm in maximizing the 
weighted revenue. We also show that our online algorithm 
achieves the highest achievable scaling law for the competitive 
ratio by any online algorithm. Furthermore, we show through 
numerical examples that our algorithm usually performs much 
better than the theoretical lower bound, found for the worst case 
arrival sample path. Our packet scheduling methodology can be 
applied to ow scheduling if the packet arrival of each ow is 
periodic and nite. Since our algorithm involves centralized 
coordination over the route which requires message passing 
and has communication overhead, the main contribution of this 
paper is on the theoretical aspect to investigate performance 
limitation of online algorithms. It is also interesting to apply 
ideas of this online framework to develop practical algorithms 
in real networking scenarios such as software de ned networks 
(SDN), where the control plane has centralized information and 
control logic. 
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Appendix A 
Proof of Lemma 1 

Let policy p* be a policy that has the same performance of 
the optimal off-line algorithm, i.e., given any arrival sample, 

R P = Sfce{l,2,...,A'} Ifc = max P S/te{l,2,...,A-} Ifc- 

If p* is a work conserving packet scheduling policy, then we 
are done. Suppose To is the rst time slot in which p* does not 
schedule packets in a work conserving way. Let p be another 
policy that is equivalent to p* before slot To, then the queue 
state of the network under policy p is the same as p* at the 
beginning of slot To. 

In slot To, there exists some node n that has a nonempty 
packet queue but does not schedule packets in a work conserv- 
ing style under policy p*. However, all nodes transmit packets 
in a work conserving way under policy p, i.e., the node n 
transmits more packets to its parent m than that under p* . Let 
k denote a packet at node n that is scheduled under p but not 
scheduled under p* in slot Tq. Then, at the beginning of slot 
Tq + 1, k is in the descendent node of m under policy p*. 

In any slot t > Tq, consider any node n and let k be a 
packet scheduled for transmission at n under p* , if k is in the 
queue of node n under policy p, then it is scheduled under 
p, otherwise, the packet scheduling decision under p for n is 
work conserving and transmits an arbitrary packet that is not 
scheduled under p* . We show that any packet that arrives at the 
root before its deadline under p* also arrives at the root before 
its deadline under p by induction. Choose T — 1 > To, and 
assume that for any packet k, if k is at node n under p in slot 
t+1 where t € (To, T— 1], then k is in node n or its descendent 
node under p* in slot t + 1. From the above discussion, this 
hypothesis holds for To + 1 and we need to show it holds for 
all packets in slot T+1. From the way we constructed policy 
p, if any node n is transmitting a packet k under p* , n is also 
transmitting a packet if the queue is nonempty. Furthermore, if 
k is in the packet queue of node n, it is transmitted under p as 
well. We then have the following cases: 
Case 1: If k is transmitted by node n under both policies, then 
hypothesis holds for k in slot T + 1; 

Case 2: If k is transmitted by node n under p* but not 
transmitted by p, then k is not in the packet queue of node n 
under p in slot T. By the hypothesis in slot T, k is in an ancestor 
node of n under p, then after transmission, the hypothesis still 
holds for k in slot T + 1; 

Case 3: If k is transmitted by p and not transmitted by p*. By 
the hypothesis for k in slot T, k is in node n or its descendent 
node under p*. Therefore, after k's transmission, the hypothesis 
still holds for k in slot T + 1. 

Therefore, for any time slot t, if any packet k is in the packet 
queue of node n under p in slot t, then k is in the packet queue 
of node n or its descendent node under p* in slot t + 1. This 
means for any packet k, if k expires under p, then k also expires 
under p*, i.e., 1? < \ p k and 

k k 



Since p* is an optimal policy and R p < R p , then R p = 
Sfc Ifc = J2k Ifc = R P which means p is also an optimal 
work conserving packet scheduling policy. 

Appendix B 
Proof of Theorem 2 

Let policy p* be a work conserving optimal off-line policy, 
i.e., given any under-loaded arrival sample, all the packets are 
successfully transmitted to the root before their deadlines under 
p* . If under p*, all nodes transmit their earliest deadline packets 
in all slots, then we are done. Suppose To is the rst time slot 
in which policy p* differs from WC-EDF p. Then, all the nodes 
in the network have the same set of packets in all slots before 
slot Tq. 

We show that WC-EDF p is optimal for any under-loaded 
arrival sample by induction. Choose T — 1 > To and let the 
following holds as hypothesis Vi € (Tq,T — 1]: 

1) There is no packet expiring under p at the end of slot t; 

2) The total number of packets at any node n under policy p* 
and p are the same at the end of slot t. Any packet k at any 
node n under policy p can be paired with a packet k* at the 
same node n under policy p* at the end slot t; 

3) For any packet pair (feg, fco) at any node n at the end of slot 
t, there is a sequence of packet pairs (k^ko), . . . , (k*, fej) at 
node n and its descendent nodes so that dk* < dfc , • • • , dk* < 
dki-!,dk* < dk, if i > 1 and dk* < dk if i = 0. 

At the beginning of slot To, all nodes have the same set of 
packets under p* and p, and all packet pairs are common packet 
pairs. Consider an arbitrary node n and suppose the capacity of 
the link from node n to its parent node is c, i.e., the maximum 
number of packets that can be transmitted from node n is c 
in each slot. Note that the total number of packets at node n 
are the same under p* and p, if this number is larger than c, 
then node n transmits c packets under both policies, otherwise, 
it transmits all packets under both policies. This means the 
number of transmitted packets of node n are the same under 
p* and p. We use the following rule to pair the transmitted 
and remaining packets: If (k*,k) forms a packet pair at the 
beginning of slot Tq, and k*,k are transmitted by node n in 
slot To under policy p* and p, respectively, then (k*,k) still 
forms a packet pair after transmission. If (k*, fc) forms a packet 
pair at the beginning of slot To, k* is transmitted by node 
n in slot To under p* but k is not transmitted by p, since 
the total number of transmitted packets are the same for both 
policies, there must exist another packet pair (q* , q) at node n 
so that q is transmitted by node n in slot To under p but q* is 
not transmitted p*, then (k*,q) is a transmitted packet pair by 
node n in slot To and (q* , k) is a remaining packet pair after 
transmission. New arrivals form common packet pairs. Note 
that all packet pairs are common packet pairs at the beginning 
of slot To, i.e., k* = k,q* = q, and under policy p, node n 
always transmits the earliest deadline packets, i.e., d q < dk- 
This means (k* , q) , (q* , k) is a sequence of packet pairs so 
that d q * < d q , d^ < dk where (fc*, q) is at the parent node of 
node n and (q*,k) is at node n. Furthermore, (q*,k) satis es 
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d q * = d q < d k . Therefore, it is easy to see that all packet 
pairs satisfy hypothesis 3) by repeating this argument for all 
transmitted and remaining packet pairs. Suppose a packet fc 
at any node n is expiring under policy p at the end of slot 
To, then there is another packet fc* with dk* < dk and k* is 
at node n or its descendent node by hypothesis 3), i.e., k* is 
also expiring which contradicting the optimality of policy p*. 
Therefore, there is no packet expiring under p at the end of 
slot To, i.e., hypothesis 1) holds. Note that the total number 
of transmitted packets and received packets are the same under 
both policies in the uplink tree network and no packets expire 
under both policies, then the total number of packets at any 
node under both policies are the same at the end of slot To, 
i.e., hypothesis 2) holds. 

Till now we have shown the base case and we need to show 
that hypothesis l)-3) hold for T. Similarly, at the beginning 
of slot T, all nodes have the same amount of packets under 
p* and p. The packet pair reforming rule is the same as 
described in the base case. Consider an arbitrary node n and 
suppose the capacity of the link between node n and its parent 
node is 1 without loss of generality. If the link capacity is c, 
then repeat the same arguments c times. Let k* and q denote 
the transmitted packets by node n under policy p* and p, 
respectively. Without loss of generality, we assume (k*,k) 
and {q*,q) form different packet pairs at the beginning of 
slot T, i.e., the end of slot T — 1. Consider any packet pair 
(fco, fco) (assume this packet pair is at an arbitrary node m) 
in the network and by hypothesis 3) for slot T — 1, (fco,fco) 
has a sequence of packet pairs (fc^, ko), ■ ■ ■ , (fc 8 *, fc,) at node 
m and its descendent nodes at the beginning of slot T so that 
dk{ < dko,- ■ ■ , dk* < d ki _ 1 , dk* < d ki if i > 1 and dk* < dk 
if i = 0. We have the following cases: 

I) The sequence (fcjj, fco), • • • , (&,*> &i) does not contain the 
packet pairs (k*,k) and (q*,q), then the reforming of (k*,k) 
and (q*,q) and the transmission of (k*,q) do not in uent the 
packet pair (fej, fco); 

II) The sequence (fcj, fco), . . . , (fc*, fc«) contains the packet 
pair (fc*,fc) but does not contain (q*,q). This means node n 
is node m or a descendent node of node m. By hypothesis 
3) for packet pair (q*,q) in slot T — 1, there is a sequence 
(q* ,q), . . . , (q* ,qj) at node n and its descendent nodes 
so that d q * < d q ,...,dq* < d qj _ 1) dq» < d qj . Without 
loss of generality, let (fc*, fco), . . . , (fc*, fc), . . . , (fc*, fcj) 
denote the sequence of (A;*,, fco) that contains (fc*,fc), then 
(ko, fco), ■ ■ ■ , {k*, q), (q*,qi), {q* , qj), (q*,k), (fc*, fc;) 
is a sequence of packet pairs at node m and its descendent 
nodes so that dk* < dk ,---,d q * < d q ,...,d q * < 
d qj ,...,dk* < dk^tdk* < dk^ If node n is a descendent 
node of node m, then after the transmission of packet pair 
(k*,q), hypothesis 3) holds for (fco,fco). If node n is node 
m, then packets fco and q are both at node n at the beginning 
of slot T, and d q < dk* by EDF. Then, d q * < d q < dk* 
and m : k ),{ql,q 1 ),...,(q*,q j ),(q*,k),...,(k*,k i ) is a 
sequence of packet pairs at node n and its descendent nodes 
that satis es hypothesis 3) after transmission of (k*,q). 



Similarly, if the sequence (kg, fco), . . . , (fc* , h) contains the 
packet pair (q*,q) but does not contain (fc*,fc), hypothesis 3) 
also holds for (fco, fco) at the end of slot T; 
III) The sequence (fc*,, fco), . . . , (fc*, &,) contains the packet 
pairs (fc*,fc) and (q*,q). This means node n is node m or 
a descendent node of node m. Without loss of generality, 
let (fco\fc ),...,(fc*,fc),...,(<7*,g),...,(fc*,fc;) denote the 
sequence of (fc^fco) that contains (fc*,fc) and (q*,q). After 
packet reforming, (fc*, fc ), . . . , (fc* ,q), (g*,?i), . . . , (fc* , fc;) is 
a sequence of packet pairs at node m and its descendent nodes 
so that d h * < d ho ,...,d q * < d q ,..., d k * < d ki _ t , d k * < d ki . 
If node n is a descendent node of node m, then after the 
transmission of packet pair (k*,q), hypothesis 3) holds for 
(fco, fco)- If node n is node m, then packets fco and q are 
both at node n at the beginning of slot T, and d q < d k * 
by the earliest deadline policy. Then, d 9 » < d q < dk* 
and (fcj, fco), (q*, q\), . . . , (fc*, fcj) is a sequence of packet 
pairs at node n and its descendent nodes that satis es 
hypothesis 3) after transmission of (k*,q). Similarly, if 
(fc*,fc ),...,(g*,g),...,(fc*,fc),...,(fc*,fci) is the sequence 
of (fco, fco) at the beginning of slot T, hypothesis 3) also 
holds for (fc^, fco) at the end of slot T with the sequence 

(fc*,fc ),...,(<f,fc),...,(fc*,fci). 

Therefore, by repeating the above argument for all transmit- 
ted packet pairs, hypothesis 3) holds for all packet pairs at the 
end of slot T. Suppose a packet fc at any node n is expiring 
under policy p at the end of slot T, then there is another packet 
fc* with dk* < d k and fc* is at node n or its descendent node by 
hypothesis 3), i.e., fc* is also expiring which contradicting the 
optimality of policy p* . Therefore, there is no packet expiring 
under p at the end of slot T, i.e., hypothesis 1) holds. Note that 
the total number of transmitted packets and received packets are 
the same under both policies in the uplink tree network and no 
packets expire under both policies, then the total number of 
packets at any node under both policies are the same at the 
end of slot T, i.e., hypothesis 2) holds. 

Appendix C 
Examples 

Example 2: Consider a down-link tree ( ow destinations are 
leaves and source nodes can be any other nodes in the tree) 
shown in Fig. 7 (a) and suppose that the link capacity of each 
link is 1. Initially at node 4, there are two packets fci and fc2 
with deadlines d kl = 3, d k2 = 3 whose destinations are nodes 
1 and 2, respectively. Suppose that node 4 transmits fci to node 
3 in time slot 1, and that there is no arrival by the end of slot 
1, then node 3 transmits fci to node 1 and node 4 transmits 
fc2 to node 3 in slot 2. Let the adversary inject a packet k$ 
with deadline d k3 = 3 (whose destination is node 2), at node 
3 by the end of slot 2, then by the end of slot 3, either k2 or 
fc3 expires. However, this arrival sample is feasible since the 
off-line algorithm transmits kz in slot 1 and all three packets 
are able to reach their destinations before their deadlines. Now 
suppose node 4 transmits k^ to node 3 in time slot 1, and 
there is no arrival by the end of slot 1, then node 3 transmits 
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&2 to node 2 and node 4 transmits fci to node 3 in slot 2. 
Let the adversary inject a packet k-j with deadline dk 3 = 3 
(whose destination is node 1), at node 3 by the end of slot 2, 
then by the end of slot 3, either fej or k$ expires. However, 
this arrival sample is also feasible since the off-line algorithm 
transmits fci in slot 1 and all three packets are able to reach their 
destinations before their deadlines. This means under scenario 
(a), no matter what online decision node 4 makes in slot 1, 
the adversary can always choose future arrivals so that the 
online decision is worse than the optimal off-line algorithm 
even though the whole arrival sample is under-loaded. This 
implies that there is no online algorithm for topology (a) that 
has the same performance as the optimal off-line algorithm. 



Fig. 7. Example Topologies 

Example 3: Consider an uplink tree (all packets are destined 
to the root) as shown in Fig. 7 (b) and suppose the capacity 
of link 3 — > 4 is 2, and the capacities of link 1 — > 3, 2 — > 3 
are 1. Initially, there are two packets ki and /c2 with deadline 
dfcj = 2, dk 2 = 3 and one packet k$ = 2 at node 2. Suppose 
node 1 transmits fci and node 2 transmits k^ to node 3 in 
time slot 1. Let the adversary inject a packet fc-4 with deadline 
rffc 4 = 2 at node 3 and a packet fcs with dk 5 = 3 at node 1 by the 
end of slot 1, then one packet among ki,k$, k^ expires by the 
end of slot 2 and one packet in k^ , fcs expires by the end of slot 
3, i.e., at least two packets expire. However, only one packet 
expires for the same arrival sample if node 1 transmits k^ in 
slot 1 . Similarly, if node 1 transmits ki and node 2 transmits k- A 
to node 3 in time slot 1, then the adversary does not inject any 
future arrivals and k\ expires by the end of slot 2. However, 
there is no packet expiring if node 1 transmits k\ in slot 1. 
Therefore, there is no online algorithm for scenario (b) that has 
the same performance as the optimal off-line algorithm when 
the arrival sample can be over-loaded. 
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